ON EXPONENTIAL STABILITY OF WONHAM FILTER 
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, ^ ^ Abstract. We give elementary proof of a stability result from Atar 

and Zeitouni, [|^], concerning an exponential asymptotic {t oo) for 
• filtering estimates generated by wrongly initialized Wonham filter. This 

^ ' proof is based on new exponential bound having independent interest. 

(N ■ 
(N 

! 1. Introduction 

In Atar and Zeitouni established an exponential asymptotic (in t — > 
oo) rate of convergence for the distance between differently initialized filter 
outputs when a signal is Markov process valued in a finite state space for 
both the discrete and continuous time cases (see related topic in [^). In 
this note, we discuss only continuous time caseQ and deal with exponen- 
tial stability of the Wonham filter. Following we assume that a signal 
^ . X = {Xt)t>o is homogeneous Markov process, valued in a finite alphabet 

\^ I S = {ai, . . . , ad}, with transition intensities matrix A (with entries Xij) and 

^SJ ' initial distribution vector v. An observation Y = {Yt)t>o is defined as 

o 

O 

a 

> 

^ I diTt = A*TTtdt + (diag(7rt) — irtirl) ha~'^ (^dVt — h*TTtdt), 

where *, diag(-), and h are the transposition symbol, scalar matrix, and 
vector with entries h{ai), . . . , h{aci) respectively. 
It is assumed in [Q] that 

Xij > 0, Vi j (1.2) 

and therefore the transition probabilities of Markov process X converge 
exponentially fast to the unique and positive invariant distribution. In it 



Yt= [ h{Xs)ds + aWt 
Jo 



where W = {Wt)t>Q is a Wiener process independent of A, a is a constant 

and /i is S M function. The Wonham filter, Q (see also Ch. 9 in[^), 
creates vr^ the conditional distribution of Xt given Y[o t] = ^{^s; s < t}, that 
is 7Tt{l) = P{Xt = ai|y[o,t]),... ,7rt{d) = P{Xt = ad|y[o,t]) : 
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is shown that this property is inherited, in some sense, by vr^. To emphasize 
the dependence of vr^ on z^, below we write ir^ instead of vr^. Assume /3 
the probabihty distribution on S, different from u, is used in (1.1) as the 
initial condition and denote vrf the solution of corresponding Ito equation 

from ( PI) . For wrong initial distributions f5' ,f5" , denote ||7rf — vrf '^\\ the 
total variation norm for difference of wrong conditional distributions. The 
following result is known from [l| (see Theorem 1.6). For any /?', /3" 

limt^ooj log ||vrf - vrf < -2 min y^Ap^A^p, P - a.s. (1.3) 

t V+q 

This result is very important in applications since it guarantees that wrongly 
initialized Wonham filter generates a wrong conditional distribution converg- 
ing to correct one exponentially fast as t ^ oo. 

The proof of (|l]^) in (see pp. 46-48 there), being the pioneer, uses 
"heavy" tools such as Oseledec's multiplicative ergodic theorem, Birghoff 's 
contraction coefficient, etc. So, it is surprising that an elementary proof of 
( |1.3D is possible and, moreover, an exponential estimate for Hvrf'^ — vrJ^H, with 
the same rate — 2minp^q y^ApgA^p, is valid for any i > 0. 

Theorem 1.1. Assume Xij > for any i ^ j- Assume v is positive and 
[3 ^ V. Then, P-a.s. for any t > 

llvrf" - <|| < (f max ^(j) max ^(j) exp ( -2min ^ XpqXqpt] . (1.4) 
jes az/ j£S dp \ pjtq J 

2. Proof of Theorem |iTi| 

For a notational convenience, write , y^" (instead of Xt, y^), if a is the 
distribution of Xq. Then, under v being the distribution of Xq, write 

7rr(i)=P(Xr = a,|y[^^,]), i=l,... ,d. 
Due to (|1.1D, vrf'' is defined as 

dvrf = A*7rf (it + (diag(7rf ) - vrf (vrf )*)/i(7-2(dy,'^ - h*4''dt). 
It is obvious that 7rf'^(i) = P{X^ = ailY^Qiy) 
Set 

Pjiit) = P{X^ = aj|y[^,],Xr = Oi), i,j = 1,... ,d. (2.2 
2.1. Auxiliary lemmas. 



(2.1) 



y/3 ._ yi^ 



Lemma 2.1. Under the assumptions of Theorem 1.1, for any i = 1, ...,d 

K(^) - T^t^m < c^max ^(j) max ^(i) max \pji{t) - Pjkit)\, t > 0. 
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Proof. Denote Q" and distributions of {X'',Y'') and (X^,y^) respec- 
tively. Both (X^.y^) and are Markov processes, with paths from 
the Skorokhod space D[o,oo)(I^^)- They have the same transition probabili- 
ties, Yq = Yq (= 0) and different initial distributions for Xq and X^: v and 
/3 respectively. Since v ^ (3, the measures Q'^ and are equivalent and 

We show first that for any i = 1, . . . , d and t > 0, Q'^- and Q'^-a.s. 

n (0 = Tjz X • (2-3) 

^(f(^o)l^o,]) 

Let {T)t)t>Q be a right continuous filtration on D[o.oo)(^^) completed by 
sets of Q'^-measure zero. For fixed i > 0, let '4^{x.,y) = V'(y)) [^^v) ^ 
D[o^oo(]K^)) be Vt measurable and bounded function. Then 

= EV;(y^)vrf (i)^(x^y'^) = i^^(y^)7^f(^) = i?^(y^)/(xf = a,) 

= E^PiY^IiX^ = a.)^(X^y'^) = E^l.{YnI{Xi: = 
bo, by an arbitrarmess of %p[Y ), we get tt^ (zj = 



and it remains to notice that 



Now, taking into the consideration ( |2.3D , write 
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Notice that by the Jensen inequahty l/ E{^{X^)\Y^'^^^^) < E{^{X^)\Y^^^^) . 
Consequently, 

K(0 - 7rf''(i)| < max ^(i) max ^(j) 
' ' jgs di' jes dp 

d 

{P{X^ = a,\Y^o,t]) - P{Xo = = a*, y(u\} 

< max — (j) max — (j) 

d 

X ^7rr(i) P(Xo^ = a,|y[o^t]) " ^'(^o = = «i,>^[o,t]) 



i=i 



i=i 



Further, an obvious formula P{X^ = il^jo,*]) = Efc=i ^^t {k)pjk{t), and (U) 
provide 



- T^ti^} I < ^(j) i^*^-^') Yl I ^t{k)pjk{t) - pji{t) 

j=i fc=i 



df3 du 
— [J ) max — 

d(5 dv 
max — — ( 1 ) max — — ( 

j& dv j& dp 



j=l k=l 



and the result. 



□ 



Lemma 2.2. (Lemma 9.5, Q.) Assume v is positive. Then, for any j G S, 
1, j = i 



0, j^i 



(2.5) 



= ^^^'^^ ~ ^^'^ '^^ ' ' = ^' • • • ' ^- 

r^^i * ^ ' 

The following lemma plays a key role in proving ([l.4|). 

Lemma 2.3. Assume v is positive and Xij > /or all i ^ j. Then for any 
i,j, k, P-a.s. 



\Pjiit) - Pjkit)\ < exp ( - 2min XpgXqpt 



(2.6) 
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Proof. Set Po{t) = min pji{t) and p'^{t) = max pji{t). Obviously, Po{0) = 

and p*(0) = 1. Since processes Pji{t), i = 1,... ,d have continuously dif- 
ferentiable paths, piece- wise constant functions^, = argmax and 

io{t) = argminpji(t) have a finite number of jumps on any finite time inter- 

val. Therefore, paths of p^{t) and Po{t) are absolutely continuous functions 
the derivatives of which are defined, in accordance to (|2.5|), as 



Notice that for any r we have Pjr{t) — Poif) > 0, and Pjr{t) — p^{t) < 0, so 
that by ( ^ ) 

dpojt) Ki4t)Kir) ^ . 

-IT- n^im) (MO-Mt)), 

Consequently, taking r = i^{t) in the first case and r = io{t) for the second 
one, we get under ^ io{t). 

If e{t) = i^{t), then = and by Q = 0. Hence, Q is 

always valid. 

Set At = p^{t) — Po{t) and notice Aq = 1. Owing to ( ^.81) , a differential 
inequality holds true 



dt - V 7rni.it)) ^n^^it)) 

Now, an obvious inequality 

(2.10) 

and 

{^i°it)ioit)X + K(t)io(t)-) = Aio(j)i^(t)Aj^(j)io(j) > 2miny^ApgAgp 



^if max and min are attained on several numbers, the smallest is taken 



6 



P. CHIGANSKY AND R. LIPTSER 



provide 

dAt 



< -2 mill J XpnXqpAt 



dt - -j^^y -Pi'-iP^ 
and the result. □ □ 

2.2. The proof of (^). Since ||7rf - vrf^^H = J^Li " ^ti^)]^ by 

Lemma we have 

II 131^ W ^ j2 d(5 dv I I 

TTi — vr; <a max— —max— — max \Pu\t] — Pnk['t]\, F — a.s. 



and then by Lemma 2.3 the result. □ 

3. The proof of (O) 



1. Assume u is positive and /?' ~ /?" ~ i/. Let P denote any of /?', P". 



Then, due to Theorem 1.1, we have 



limt^ooj log IK - vrf'^ll < -2min ^^XpgXgp, P - a.s. (3.1) 

t pytq 

Hence, by the triangular inequality 

\\n - n II < iFt - II + IK - II 

^ o /'ll P'l' y\\ II ^ 

< 2max(^||7ri^ - vtj ||, HvTi^ - vtj 
( |L3D holds true. 

2. It can be readily checked that for any fixed 5 > the values vr^ and vr^^. 



defined by (1.1) and ( p.l| ) respectively, have positive entries Q'^-a.s. Now, 



the original filtering problem, under obvious redefinitions, can be translated 
into filtering problem on [5, oo) for which (|1.3|) follows. 
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